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Abstract 

Maximum likelihood estimations for the parameters of extreme value distribu- 
tions are discussed in this paper using fixed point iteration. The commonly used 
numerical approach for adressing this problem is the Newton-Raphson approach 
which requires differentiation unlike the fixed point iteration which is also easier 
to implement. Graphical approaches are also usualy proposed in the literature. 
We prove that these reduce in fact to the fixed point solution proposed in this 
paper. 

2000 AMS Classification: 62F10; 62N02. 



1 Introduction 

Extreme value distributions are largely used in applied engineering and environmental 
problems (see the book by Coles [1]). Parameter estimation is the first step in the sta- 
tistical analysis of parametric probability distributions. The most widely used approach 
is the popular maximum likelihood estimation (MLE), but usually, as for extreme value 
distributions, the solution is not analytic and must be then approached by numerical 
techniques. The commonly used one is the Newton-Raphson algorithm to determine 
the maximum likelihood estimates of the parameters. To employ the algorithm, the 
second derivatives of the log-likelihood are required. Sometimes the calculations of 
the derivatives based on the progressively Type II censored samples for example are 
complicated (see [7]). To avoid such computation, we propose to use the fixed point 
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iteration algorithm instead. In this paper we prove that generally MLE of extreme 
value distributions could be expressed in a fixed point iteration form which is easier 
to implement and does not require differentiation. Graphical techniques were also pro- 
posed as alternatives (see Balakrishnan and Kateri [2] and Dodson |5J) which have the 
disadvantage of using visualization to detect the solution from graphics. We prove that 
these graphical solutions reduce in fact to fixed points of a suitable iteration forms. 

In the following section, we propose fixed point iterations for estimating the param- 
eters of the Gumbel and Weibull distributions from complete data. In section 3, we 
extend the procedure to censored samples (simple and progressive Type I and Type II) 
using the Type I least extreme values distribution from which estimations for Gum- 
bel and Weibull distributions can be deduced from suitable transformations. Finally, in 
section 4 we illustrate the proposed approach using examples quoted from the literature. 

2 Maximum Likelihood Estimations for Complete 
Data 

2.1 Type I extreme value distribution 

The Type I extreme value distribution which is also called Gumbel distribution function 
is defined as: 

F(x) = exp | — exp 
for x G M, and it has the probability density 

f(x) = - exp 
a 

where a > and fi G JR.. Let complete sample from the Type I 

extreme value distribution. 

The maximum likelihood estimator for a is known to be the solution of the following 
equation 

_ Sr=i x i ElU^p(-f) m 
EILiexp(-f) • 1 j 

Denote the right hand side of by g(a; x). Then the equation (TjQ) is in fact in a fixed 
point form 

<r = g(?;x). (2) 

Unlike the Newton-Raphson method, which is the commonly used nonlinear numerical 
method for solving MLE of the extreme value distribution (see Cohen [3] p. 143), 
the fixed point approach does not require differentiation and then is more easier to 
use. Uniqueness of the solution of ([!]) can be proved using graphical techniques (see 
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Balakrishnan and Kateri [2]). Indeed, the left hand side a is monotone increasing on 
a. We then have to show that g(cr;x) is monotone decreasing on a. 

dg(a;x) _ Er=ifi exp(-^)Er=i^exp(-f)-Er=iSexp(-f) (EHi exp(-f )) 
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It remains then to prove that 

n n n / n 
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Setting di = x^exp (— §£J and 6j = exp (— fj) , i — 1, ...,n, g*(cr;x) becomes 
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and g*(cr;x) < by the Cauchy-Schwarz inequality. The last result can be deduced 
from the result of Balakrishnan and Kateri [2j from transformation between the Weibull 
and Type I extreme value distribution. It should be noted that lim^oo g(a; x) = and 
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We deduce then that < a < E ^ X(l) - x {1) and < g(a; x) < E ^ a(<) - which 
also guarantees the existence of a solution (see Lemma 3.4.1 of [I]). After obtaining a 
solution for a we deduce the MLE of fi from 



\x = a 



In 
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(3) 



Example 1 Consider the data about annual wind-speed maxima in km/h from 1947 to 
1984 °& Vancouver quoted from the software Xtremes 4-1 ffflj - provided with the book 
by Reiss and Thomas JE/, stored in the file em-cwind.dat (the source is 16]). By fitting 
a Gumbel distribution to the data, they provide estimates for a and fi as a = 8.3 and 
ju = 60.3. The fixed point iteration (TJ|) leads to the solution a = 8.2891 and from (TJ|) 
we obtain /2 = 60.3504. 

2.2 Weibull distribution 

For the two parameters Weibull distribution W{0,(3) with pdf 

/ (x; 6, (3) = ^x 13 - 1 exp [- (x/9f] , x > 0, 9, (3 > 0, 
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which is the Type II extreme value distribution it can be deduced from [2] that 



(4) 



where g w (P;x) is given by 
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It has been proved in [2] that (g w (/3; x))' 1 is a monotone increasing function then 
g w {(3',x) is monotone decreasing which insures existence and uniqueness of the solution 
of the fixed point iteration (j3J). The MLE of the parameter 9 is deduced from 




3 Estimation for Censored Data 



3.1 Singly right censored samples 

In the case of simple Type-II censored data, let r (1 < r < n) denote the number of 
observed lifetimes and x = (x(i), X(2), X(r)) the ordered observed lifetimes from the 
Type I least extreme value distribution with probability density 
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If X is a random variable from a Type I greatest extreme value distribution with 
location parameter \i and shape parameter a then —X follows a Type I least extreme 
value distribution with location parameter —\l and shape parameter a [3|. But if we 
have a Type-II rigth censored data x = (x(i), X(2), £(r)) from the Type I least extreme 
value distribution then y = (— X( r ), — X( r _i), — X(i)) will be a Type-II left censored 
data from the corresponding Type I greatest extreme value distribution. The MLE of 
a is given by the following fixed point iteration expression 



° = 9{^;x), 



where now 

g(cr;x) 
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It can be easily proved that g(a; x) of (jSJ) is a monotone decreasing function in a exactly 
along the lines of section 2.1 by taking 



I (1 < i < r ) X{i) ex P ( — "2^") + -^( r + l<2<n) ^(r) exp ^- 
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J (1 < i < r) exp ( ) + J (r + 1 < z < n) exp 



which guarantees existence and uniqueness of a fixed point for a. The parameter \x is 
then obtained from 



Li = a 



In 



ELiex P (-^) + (n-r)exp(-^) 



If ■■■,y( r ) designate the r smallest observations in a random sample of size n from 
a two parameter Weibull distribution W (#,/?) then X(i), ...,2( r ) where = ln?/(j) will 
designate equivalent observations in a sample from the Type I distribution of smallest 
extremes [3]. The MLEs 9 and (3 of the Weibull distribution will then be deduced from 
the relations 9 = expju and (3 = l/a. Meanwhile, fixed point iterations hold also in this 
case for the Weibull distribution from the relation 



(3 = g w ((3;x) 



where now 



(7) 



g w {(3]x) 



-1 i=i 



lnx w + (n - r) xf r) lnx (r) 



(r) 



+ (n-r)x 



1 r 
--Fin 



X 



(<)■ 



i=l 



(r) 



i=l 



From [2] it has been proved that g w (/3',x) 1 is monotone increasing in (3 then g w ((3;x) 
in (J7D is monotone decreasing which insures existence and uniqueness of the fixed point 
(3 of the iteration ([7]). 

The MLE of 9 is deduced from 



(9) 



For Type-I censoring, it suffices to replace the term X( r ) in the (n—r)x^ exp (— X( r )/a) 
and (n — r) exp (— X( r )/a) terms of relation ([6]) by the pre-specified time of testing T 
and in the terms (n — r) a£> lnx( r ) and (n — r) a£> in the relation (jSJ). 

Example 2 In i/izs example we quote a Type-II censored data from |5]/. These data 
are about testing twenty identical grinders, with the test ending at time 152.7. In this 
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period, twelve grinders failed. The observed failure times are presented in the following 
table 

Table 1 

Type-II censored failure data from Dodson (2006) 

12.5 244 58.2 68.0 69.1 95.5 96.6 97.0 II4.2 123.2 125.6 152.7 

By assuming a Weibull distribution the graphical approach of [2] leads to solutions 
(3 = 1.647 and = 162.223. Using the fixed point iteration we obtain the fixed point 
solution f3 = 1.6467 and from 9 = 162.223. This shows that the graphical approach 
proposed in JM/ reduces in fact to a fixed point iteration. 

3.2 Progressively censored samples 

Consider a progressively Type II censored sample from a Type I least extreme values 
distribution with Rj, j = 1, ...,r the number of censored items at failure time j. We 
have the following fixed point iteration for the MLE of a 



It can be proved using similar arguments of the preceding section that g(o~;x) is a 
decreasing function on a which insures existence and uniqueness of a fixed point for a. 
The MLE of fi is then deduced from 



For the case of a Weibull distribution with progressively Type II censored sample, 
we obtain from [2] that there exists a unique fixed point solution (3 of the following 



= g(°;x) 



(10) 



where 
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equation 



(3 = g w (/3;x), 



where 
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We have for the MLE of 9 
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Example 3 Consider the progressive Type-II censored data analysed by Viveros and 
Balakrishnan J2J/ o,nd given in the following table 

Table 2 



Progressive Type-II censored failure data from Viveros and Balakrishnan (1994) 



i 


1 


2 


3 


4 


5 


6 


7 


8 


x {i) 


-1.6608 


-0.2485 


-0.0409 


0.2700 


1.0224 


1.5789 


1.8718 


1.9947 


Ri 








3 





3 
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Fitting a Type-I least extreme values distribution to these data and using the Newton- 
Raphson numerical method they obtain a = 1.026 and /2 = 2.222. Using fixed point 
iteration [TP) we obtain the solution a = 1.0264 and using l[Tl\) we obtain Jl = 2.222. 
In order to compare the convergence rate of the fixed point iteration with that of the 
Newton-Raphson method and the EM algorithm used in |7]/ 7 same initial value a = 
0.7912 (and fi = 1.4127 for the Newton-Raphson and EM algorithm methods) were 
used and the level of accuracy was fixed at 5 x 10~ 5 . The Newton-Raphson method used 
in JMI took 37 iterations and the EM algorithm took 151 while the fixed point iteration 
took 12 iterations to converge to the same values. 
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